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ABSTRACT . , 

N Research on the 'use bf, knowledge resources in school 
improvement efforts explores the ways in which new ideas, progratns, 
'practices, materials, and technologies become incorporated into the 
operations of the nation's elementary and secondary schools, and 
Examines the changes these organizations undergo in the process • 
Attempts at disseminating research findings and implementing programs 
based on those findings have revealed many problems that can only be 
resolved with adequate research on knowledge use. This research 
concentrates on four major topics: the change process that occurs 
when inno<ratiqns are attempted; the mobilization period preceding 
implementation of new programs; the contextual influences affecting 
implementation; and the ways in wjiich externally-generated knowledge 
enters the school environment. *Chis discussion of the ^current state 
of research on knowledge use includes descriptions of 10 active 
projects funded by grants from the National Institute of Education 
and concludes with brief analyses of three areas that will receive 
emphasis in the futurfe. (Author/PGD) 

■ *■.<> 



r 



*************************************************** 

* Reproductions supplied by EDRS 'are the best that can be made ' * 

* from the original document. 

*********************************************************************** 



DISCUSSION 
DRAFT 



A 



KNOWLEDGE USE AND SCHOOL IMPROVEMENT 



Rolf ^ehming 



u s department of education 
National institute of education 

educational resources information 

CENTER fERlO 
V This document has been reproduce^ as 
\ received from ihe person or organyatson 
originating it , 

Minor changes have been made to /nprove 
reproduction quality \ 

• Points of view or opinions stated ir/:bts docu 
n-ent 0:0 "ot necessary represen/off'ca 1 N!£ 

DOSiton or pof=CY 



PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC) " 



AERA Annual Meeting 

March 21> 1982 

New York ' City # A New York 



Th4 views expressed are the, chthor's. Official agency ^position and 

are not necessarily reflected, and no endorsement by the National Institute 

of Education should be inferred. r 



Overview 

k ^ . 

Schools and school districts will continue to face pressing educational prob- 
1 ' lems and changing social and fiscal realities requiring adaptive action. 

Meeting 'such demands purely locally by invent if>g and trying out suitable re- 
sponses in isolation from others is likely to be beyond the shrinking resources 
of many districts. In fact, service and technical assistance units in govern- 
mental, academic and private organizations can provide information and exper- 
tise on an as-deeded basis, and in some instances schools have collaborated in J 
improvement efforts. The questions arising for assisting^rganizations ancT\^' 
schools are: How can one most effectively develop and implement .the necessary 
programs so that local initiative and motivation are preserved, disruptions are^ 
i — minimal, unforeseen and undesirable consequences held to a minimum? And what 
kinds of assistance are appropriate under a giver^set of circumstances? 

The research area on Knowledge Use and School Improvement is designed to con- 
tribute to the'answers to these questions. It explores how knowledge resources 
- in the form of new ideas, programs, practices, materials and technologies be- 
come incorporated into the operations of the nation's elementary and secondary 
schools, and what changes these organizations undergo in the process. This is 
what is*meant by research on knowledge use. 

The research area is built principally around a research grants programthat . 
has made ten awards to date (see below), with ar^ther small number pending. 
While tentative plans for a future competition exist, no binding decision has 
been made by the Institute to date. Work undertaken as part of the . research 
area's development has resulted in a book, and discussions are underway re- 
: ^garding publication of two sets of papers, one methodological, the other sub- 
" stantive. All are listed in the Attachment. 

Major Problems and Issues 

During the past two decades, governmental and private agencies have expended 
' considerable effort and resources in studying the nature of educational proces- j 
ses, with the aim of eventually improving them. The federal government, re- J 
spending to Congressional mandates, had assuned a strong leadership role in 
this research, providing both direction and funding. It soon became evident 
that producing research results, and developing materials and products that in- ■ 
corporated their findings, did not automatically or even frequently lead to 
applying what had been learned in actual school practice, let alone improving 
* •' education. A stress on disseminating the new knowledge resulted, and federal 

programs were soon joined by those of 'states, foundations, and academic insti- 
tutions. More than one observer 'has suggested the underlying image of a proj 
- duct ion-consumption system: Research developing new knowledge that would be 
.disseminated to schools for consumption. and use. All too frequently, tnougn, , 
the diet did not go down well — the difference between the dissemination and ; 
adoption of a neW. practice and its actual and productive use was being -Iff rned, 

"' • - accumulating. ovy several years suggested: \ 
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Changing school practices involves sometimes far-reaching t , 
organizational and personal adjustments; 

•» 

the power of new knowledge to bring about such changes is 
mote limited than had been assumed; 

the motivations and aims of school staff critically affect < 
* the uses of externally producfed knowledge resources; 

the'school's /organizational features and context pwwer- 
fully/inf luence and shape any improvement efforts; 

undesireSf and unexpected side effects of school in^rove- 
ment efforts may. develop and undermine their effectiveness; 

school-improvement policies and programs must be ^considerfed 
against the backdrpp of normal daily operations, which 
they disturb.- From this view, even 'the most desirable 
new programs entail monetary and nonmonetary cost's that^ 
can influence their development and its ultimate potential 
benefits. v . * 

Similar conclusions, allowing fpr differences in the^aetting, are evident from 
reviewing the results of research on innovation and mange in a number of 
other fields such as health care, agriculture, private industry, and the pro- 
vision of urban seryices^ 

*» 

Research Topics 

kFour broad topics summarize the approach taken by the Knowledge Use research 
area. In each, the core focus is on explorifig the actual and potential con- 
tributions of knowledge resources in. improving the educational practices and 
services of schools. . . *** ■ ♦ , 

The Change Process: As noted, changes in organizational and personal : -behavior 
are often reauired when a new program or practice is brought into a school's 
daily operations; The initial mobilization of energies, commitment, and re- 
sources; the nature of the program in question, its development and implementa- 
tion; and the program's subsequent staying 'power and effectiveness are related 
in important ways, with earlier events' and decisions providing the boundaries 
of probable later choices, events, and results.' Such changes do not move 
mechanically from phase to phase and will not be entirely predictable even ■ 
with the best of understanding. However,- major regularities can surely.be 
understood, and knowledge of their- nature'can provide valuable guidance in the 
.development and implementation of improvement programs, wherever. initiated. 

Mobilization;' This term covers- the initial phase of a change, when school 
staff consider and prepare 'for an improvement program, whether to be locally 
developed" or drawn from outside the school or district. Whether there is a 
problenTrequirino correction, what its .nature is, whether it requires incre- 
mental or more seeping action, .which course to pursue, and how' to develop and 




sustain et^ff sjjgport are among the issues arising during this phase (and con- . 
tinuing to be faced, in rofmy instances, throughout the project duration). 
Evidence strongly suggests the importance of this phase for subsequent ones 
and final results, and more detailed knowledge of its dynamics is desirable, 
even though the -methodological and logistical problems of studying it are 
considerable. *' ' 

Contextual Influences: Increasingly, scholars of innovation and change, are 
stressing the importance of "knowing the territory" before attempting to 
introduce" changes.'' The view that different policy- contexts school settings, 
program types — may require different policy Initiatives and approaches is 
gaining broad currency, although it is not universally accepted. Much par- 
ticular context and program features are critical to success in given situa- 
tions has not been empirically established, and even many conceptual under- 
pinnings of such a contingency- approach remain to be worked out. 

-Knowledge Acquisition and Use; Schools as organizations and educators working 
in them do, of course, acquire and use knowledge resources in their da-ily work 
and apply them in their efforts to improve educational services. Yet we know 
surprisingly little about schools 1 internal information environments — how 
external knowledge enters and from what sources; how it interplays with knowl- 
edge already-available in the school; and how it is communicated, assessed/ and 
transformed so it cpn be usefully employed. Studies of information acquisition 
' and flow in research laboratories, industrial firms and other settings come to 
mind, but these have few counterparts examining school settings. 

. The program Initially had a topic area specifically targeted to methodological 
issues in knowledge use research — what constitutes use, how to measure it, 
what design issues to consider In this kind of research, etc. The initial 
set of projepts, together with the set of methodological papers already 
mentioned, sufficiently address these basic issues, so "f hat they now are best 
pursued in the context of specific substantively oriented studies. 

Lessons From the Competitions 

Several lessons can* be drawn from the submissions received by the program and 
from conversations with ootential and actual applicants. The research soli- 
" cited under the program frequently draws proposals for the demonstration or 
evaluation of a specific program in a ^pcfcif ic jS ite, both of which, are ineli- 
gible. Furthermore, too many proposals' fail to make the transition between 
laying out a problem and devising a convincing and reasonably complete research 
design with which to tackle it. 

Substantively, there is a surprising paucity of studies proposing to examine 
multi-program interactions. As noted above, there is also very little work 
that explicitly takes a contingency approach. For example, what can one 
' Empirically determine about the appropriateness of directed-developnent, high- 
fidelity approaches as opposed to local-development, local-adaptaUon ap- 
p oSnes ^particular seSings? Relatively few proposal « deal dT^ly wi th 
the work incentives of school personnel and those with whom they inter-act 
4url£ a change effort, and the effects of these incentives on program out- 
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" v Active Projects ^ 

Of the ten active projects, two are small grants; two have methodological 
topics; several others have strong methodological components. For each 
project, contact informatiop is provided tp allow interested persons to 
communicate di^ctly^ with "trie ■ investigators. > 

Knowledge Use in Urban Elementary Schbols; Marianne An^TrejJUana Edward 
Chittenden ; grant NIE-O81-002^ f 2-1981 through '4-1982. This study of 
reading aqd language competency programs in 6 urban elementary schools 
explores how external knowledge is modified by classroom and school life 
experiences of teachers and administrators. Reading improvement -programs 
designed principally for poor and minprity children will 'be the specific 
focus. An existing ETS data base is being /supplemented with additional 
information deriving fxom classroom observations, teacher and administrator 
interviews during site visits, and records of, analyses of student reading 
tapes by teachers. (Write to: ETS/- Rosedale Road,' Princeton, NJ 08541.) 

A Conceptualization of the Interface Between Teachers' Practical Knowledge " 
and Theoretical Knowledge in Effecting Board Policy; Michael Connelly ; 
grant NIE-G-81-0020, 2-1981 through 2-1983. Set in T«onto innSr-city schools, 
the project focuses on the Board's Race Relations PollSFy, It seeks to gain 
insight into the practical knowledge and reasoning" of urban teachers in 
, mqlti-ethnic schools in the context of the policy and curriculum; programs 
for ethnic equality and opportunity; identify and conceptualize tjie form 
and content of the 'translate^ theoretical knowledge '' embodied in the ; 
policy and curricula, as tfc£s knowledge appears to school personnel; to 
•'clarify the^interplayjof this 'theoretical knowledge' with the practical 
^knowledge of school staff; and to work out dialectical methods of school 
reform that preserve the integrity of school staff and contribute to theif 
professional development. (Write to: OISE, 252 Bloor.St. West, Toronto, 
Ontario, MBS 1V6, Canada.) 

Practice Improvement — The Practitioners' Perspective; El eanofl Farrar and 
David Cohen ; grant NIE-G-81-0017, 2-1981 through 1-1983. The nature of 
.information teachers and administrators believe they rieed in relation to com- 
pensatory, education programs operating in their schools 4 is explored 'in twelve 
mostly urban elementary and secondary schools. 'The study will describe How 
practitioners' beliefs and perceptions are shaped by their work and its 
setting, including the nature of the improvement program itself, social and 
other 'aspects of school "life, and generic aspects of classroom practice. The 
results of extensive interviews will be< interpreted in light of theoretical , 
perspectives- drai&n from work on the sociology of school and classroom, 
decisionmaking, and accounts of teachers' work lives. JWrite to: Huron 
Institute', 1-23, Mt. Auburn St., Cambridge MA 02138.) 

The Realities of School Improvement Progra ms — Analysis of Quantitative - 
Data; Matthew Miles (in collaboration with Mich ael Huberman); grant NIE-G- 
81-0018, 1-81 through 9-82. How do school staff deal with innovative pro- 
grams over time' and become more skillful in their use? How do the programs 
themselves change in the process? How do they become durably and success* 
fully established? How do personal motives, incentives, and career inter- 
ests, influence- the fate of these programs? The data base consists of inter- 
view and observation data originally collected by the investigators as part 
•■of a study of federally funded dissemination programs, here subjected to 
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more extensive analysis. Data are available for twelye elementary and 
secondary schools and will be supplemented during the course of the study 
by contacts with teachers and administrators, at each site. A methodological 
component deals' with methods of effectively and fruitfully analyzing data 
bases of the kind used in this study. (Write to: Center for Policy Research, 
475 Riverside Dr., New York NY 10115.) - 

Knowledge Use in Staf f-Initiated School Improvement: Wil liam Genova; grant 
NIE-G-81-0025, 2-1981 'through 6-1983. This is a study of locally-initiated 
staff development projects and their uses pf available knowledge resources. 
It explores hpw teachers' and administratprs* needs fpr effectiveness, 
affiliatipn, and control interact with their perceptions pf the need far ' 
improvements and the feasibility pf bringing them about; and it seeks tP j 
relate the interplay pf these factors to npdes of knowledge use. Data will 
be gathered in eighty 'sites with already-completed 'projects, forty sites . 
with currently active staf-f development prcjects, and twenty sites withcut % 
such, prcjects. All sites are-located in Massachusetts, (write tp: TDR 
Associates Inc., 385^Elliott. St. , NewtPn MA 02164.) 

The Develppment J Knowledge Use Capacity ' in Schcpl Districts' Programs for 
Yo ung Handicapped* Children: Ronald Wieqerinkj grant NIE-C-81-X)015. The 
principal study question, just what constitutes a school district s capacity 
for knowledge use, is explored by asking;: What influences its ability to - 
^obtain'and use knowledge resources in developing more effective Programs. 
What role do district-internal resources and procedures play in this. How 
do external factors and initiatives play? What knowledge gaps are encountered 
by school staff during program development? Half of the 24 districts are 
located in high-support states, the other in lpw^support ones Twelve sites 
.will be studied intensively oyer time. In addition to substantive findings, 
the project will produce a set of instruments for assessing .knowledge use 
capacity in school districts. (Write to: School of Education,' Childhood 
Development and Behavioral ScienceAjIniversity of North Carolina, Suite 30O, 
NCNB Plaza, Chapel Hill NC 27514.) . ' , 

Teacher Reflecti ons' on Classroom Life — An Em pirical Base for Professional . 
Development: Marv-Louise Holl y ; small grant NIE-81-0014; ,The invest igator and 
a- group of teachers reflect on the teachers' work situations in the context of, 
an inservice staff development project. Diaries kept over a^e-year period 
fprm the basis of a continuing seminar. Questions addressed include work 
problems and satisfactions; events and characteristics of-. the work that have 
particular influence on -teachers' work; ways in, which activities and courses^ 
intended tcUielp teachers do so or fail; and ways in which teachers assist- . 
each other, implications for professional development projects will -bj ... 
drawn. (Write to: Kent State University, 233 Lowry Hall, Kent OH 44242.) _ 

Knowledge Uti l ization and Program Outcomes llLSSl^^^^^Mg^ ^r^ 
Improvement Networks: Roger Collins ; small grant NIE-G-Bi-0023, 1-198 1 -though. 
3-1982. Two school improvement networks formed on the basis of court mandate 
in the course of the Boston desegregation case are studied to describe their * 
structure and operations; how these ih turn influence the nature- of the 
knowledge transfer and use activities in the networks; and what resplts occur 
i^ems of pro-am outcomes. Each.network consists of a university, a school. 
In* associated narent-community council and seeks to establish an integrated 
i^^^^^t/no^ inc^e observation, interviews, and 
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Methodological* Research on Knowledge Use and School Imgrov.effent; William' Dunn 
and Burkart Holzner ; grant NIE-G-81-0019. The investigators seek tp clear up 
some methodological and conceptual muddles at the core of research on knowledge 
use. What i§ 'use 1 under; a. variety of circumstances? Wh$t influences percep- 
tions of knowledge relevance, cogency, and adequacy? How can decisions regard- 
ing knowledge use or nonuse be measured? Instruments will be developed, along 
with a taxonomy of the dimensions of knowledge-infuse and the standards used 
by school personnel to assess such knowledge, and with procedures for analyzing 
teachers' and administrators' decisions regarding Knowledge use in daily educa- 
tional operations. A measurement handbook; a paper on the taxonomy; another on 
a decision^focused approach to examining schools' knowledge use; and a nuntf^er 
* of working papers are anticipated. (Write to: University of ^Pittsburgh, Research 
Office, 1028 Cathedral of Learning, PittsFurgh PA 15260.) 

Evidence and Conclusion in Knowledge Utilization Research; Robert Yin; grant % 
NIE-G-8 1-0016, 2-1981 through 7-1982. This methodological^study examines ten 
to twelve recent or current knowledge utilization studies to determine:^ type \ 
of* knowledge utilization network being studied — personal, organizational, 
or mixed;* and the methodological aspects of the study" — units of analysis, 
'sampling, types of evidence used. The work arises from the convictipn that % ij 
differences in types of knowledge utilization networks have not been properly 
recognized in choices of methodology. The aim is to delineate current practice 
and suggest methodological guideposts for future work. Data derive from docu- 
ments and interviews with, investigators. A case method is employed. (Write 
to: "Abt Associates Inc., 1527 .New Hampshire A</e. NW, Washington DC 20036.) 



^ * Future Plans , • 

Existing program plans contain a number .of future activities in this research 
area. In addition to- the . future competition or competitions already mentioned*. 
These include: . * • . 

• A review of the entire research area to determine the 
collective quality of the supported work, the coverage 

, it provides of important research topics, and the advance- 
ment o£ our understanding it provides. This will not take 
place in isolation, but will consider contributions from 
"pertinent studies' funded elsewhere and focusing on educa- 
j tion and other service areas. Dne aim is to assess whether 
this research program should be' continued in substantially 
1 its present form, redirected, or terminated. * 

i 

• Preparation' of a review work of the fields progress, * - 
drawing principally but nofc 'exclusively on studies in. edu- 
cation. The results and findings from individual projects 

* are customarily published in journals or as monographs, * 
whefeas jfeis review would attempt an assessment of the 
state ofjllbe art at this future time, for both research 
and resojBch planning purposes. 



• Translation and- dissemination of the^ research findings for . ^ 
-policy and practitioner audiences, including school person- 
nel, those assisting in planning and implementing school v 
improvement programs, and policymakers and program managers. * 
Presenting results and conclusions to these diverse groups 
with very different information requirements will present 
a major test of how well REP has learneci the lessons of 
its own research. 
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J - 1 ATTACHMENT j V 

Lehmirig, Rolf and Michael Kane, eds. , Improving Schools: Using What We Know; # 
Beverly Hills, Sage Publishing, 1981 (with contributions by Ernest 
- House, Matthew Miles, Sam Sieber, Karen Louie, .MichaeUFullan and 
PauT Berman) ' ZJ 

Batema'n, Peter and Robert Yin, Targeting Educational Improvement Resources; 
3-1981 * ' , 

> 

Huberman, Michael, Finding and Using Recipes for Busy Kitchens; A Situational 
Analysis gf Routi ne Knowledge -Use , in Schools; 12-1980 * 

Feller, Irwin, A Comp ai'ison of Innovation Processes' in Public Schools and 
Other FQBllc Sector Organizations; 3-x98i » 

Meyer, John W., The Im pact of the Organizational St ructure of»American Public 
Education on Innovation and Knowledge Use; 5-1981, * 

Mitroff, Ian I., The Fantasy of Certainty; How Education Seeks 'to Obtain Firm 
Knowledge From Shaky Assumptions; 4-1981 * ' 

Rich, 'Robert: F. and-Neal M. flnlrismith. Forms and Aspects of Knowledge Use_ 
Which Influence Its Use; .7-198i * 

Walker, Warren E» and Jan M* Chaiken, The Effects qf Fiscal Contraction On 

Innovation in the Public Sector; 4-1981 * 
Yin, Robert K. ," Ne^App^oaches jo the Problem of Jmoroving ^ucation ^ractice 

Thr'oudftf New Ideas; 7-1981 * 
Andrews, Stevg„ /KU in Context; Suggesti ons Towards a Mapping; H-l§81 < 
ill, Gene E.", ' issues in Ar * ^™ Change Process Outco mesi 11-1981 '* , ^ 
Larsen, Judith K., Knowledge Use" Outcomes:, 5-1981 * ^ 

Rich, Robert P. with Neal H. Goldsmith, Measur^ng)^ 
7-1981 * , .1 

» . P 

ft 

* Publication plans pending for 'these papers; they either "are, or will shortly 
be, available .through the ERIC system. 
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